This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 

IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



(19) 



J 



(12) 



(43) Date of publication: 

13.01.1999 Bulletin 1999/02 

(21) Application number: 981 12589.1 

(22) Date of filing: 07.07.1 998 



Europdiscnes Patentamt 
European Patent Office 
Office europeen des brevets 

EUROPEAN PATENT APPLICATION 

(51) intci. 6 : G06T3/40 



iiiniiviiniiiii 

di) EP 0 890 922 A2 



(84) Designated Contracting States: 


(72) Inventor: Watar, rto 


AT BE CH CY DE DK ES R FR GB GR IE IT U LU 


Ashigarakamt-gun, Kanagawa-ken 258 (JP) 


MCNLPTSE 




Designated Extension States: 


(74) Representative: 


ALLTLVMKROSI 


KJunker . Schmitt-Nilson . Hirsch 




Wlnzererstrasse 106 


(30) Priority: 08.07.1997 JP 182656/97 


80797 Munchen (DE) 


(71) Applicant: 




Full Pnoto Rim Co., Ltd. 




Kanagawa-ken (JP) 





(54) Method and apparatus for generating image file 



(57) Upon generating a plurality of image data sets 
at different resolutions from a digital image obtained by 
a film scanner or the like and recording the data sets in 
a recorcfing medium as an image file having a hierarchy 
such as the one defined by the FlashPix standard, 
image quality degradation caused in generation 
processing of the image data sets at different resolu- 
tions can be minimized. Image data 9 for printing are 
generated in order to generate photographic print 5 by 



carrying out interpolation processing by interpolation 
processing means (printing image data generating 
means) 13a on an original image 8 obtained by an 
image obtaining apparatus 10 or 1 1. Image data sets 7 
at different resolutions are also generated by directly 
carrying out interpolation processing by interpolation 
processing means (stepping resolution image data set 
generating means) 13b on the original image 8. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to an image fie gen- 
erating method and apparatus which is used upon 
recortfng a digital image obtained from a f im or a digital 
camera as an image fie in a recording medium such as 
a CD-R and an MO disc. 

A digital output service has been carried out 
wherein a digital image read from a film is recorded in a 
photo CD, an MO disc or the like and provided to a cus- 
tomer. In the FlashPix standard proposed by Eastman 
Kodak Co., a structured storage fie comprising a stor- 
age and a stream including image data and various 
kinds of property information thereof has been defined 
as an image file format appropriate for a digital output 
service regarding photographs. 

A dgrtady output photograph is used for apprecia- 
tion by cf splaying it on a monitor and for generating 
additional print afterwards. On this occasion, the resolu- 
tion appropriate for printing is generally different from 
that for monitor display. Furthermore, in the case of a 
monitor, the resolution necessary for display varies 
depending on the size of a monitor screen. Therefore, 
an image fOe defined by the FlashPix standard has a 
plurality of image data sets at different resolutions. 

A digital output service such as the above is often 
used in combination with printing service when a film is 
deposited for development, tor example. Therefore, as a 
system for smoothly operating such a service, Fuji 
Photo Rim Co. Ltd. has proposed a photograph finish- 
ing system which carries out both generation of photo- 
graphic print and output in a recording medium at one- 
time film reading (see Japanese Patent Application No. 
9<1997)-191661 and U.S. Serial No. 08/974,888). In 
Japanese Patent Application No. 9{1997)-191661 and 
U.S. Serial No. 08/974,888, a system has been 
described which carries out output in a recording 
medium by using a fBe format based on the FlashPix 
standard. 

More specifically, the above photograph finishing 
system carries out tone processing and color process- 
ing on a digital image obtained by a film scanner or a 
digital camera, and outputs print of the image after 
enlargement or reduction of the digital image in accord- 
ance with the print size and sharpness enhancing 
processing or the like carried out thereon. The photo- 
graph finishing system also converts the digital image 
after the sharpness enhancing processing into a file for- 
mat based on the FlashPix standard and records the file 
in a recortfing medium. 

In the FlashPix standard, four kinds of interpolation 
filters are defined which generate half-resolution image 
data from high resolution image data. Therefore, a dig- 
ital image having been obtained is generally enlarged to 



the print size, and sequential interpolation processing is 
carried out on the image tor printing by using the inter- 
polation f iters of the FlashPix standard. In this manner, 
image data at resolutions 1/2. 1/4, 1/8, and 1/16 of that 

5 of the original digital image are generated. 

Quality of a digital image generally degrades by 
repeated enlargement or reduction processing. In other 
words, the smaller the number of repetition of enlarge- 
ment or reduction processing, the better the quality is. 

10 However, in the above photograph finishing system, 
lower resolution image data are generated by repeated 
interpolation processing on high resolution image data 
generated for printing. Therefore, image data other than 
the ones for printing have experienced at least two 

is times of interpolation processing. 

SUMMARY OF THE INVENTION 

Based on consideration of the problems descrfred 
20 above, an object of the present invention is to provide a 
method and apparatus which minimizes image quafity 
degradation due to enlargement or reduction of a digital 
image 

An image file generating method of the present 

2$ invention generates image data for printing at a resolu- 
tion appropriate for printing and image data sets at dif- 
ferent resolutions changing stepwise and lower than the 
resolution of the image data for printing by using a dig- 
ital image obtained by an image obtaining apparatus. 

30 and generates a structured storage file comprising the 
image data for printing and at least one of the image 
data sets at different resolutions as components of the 
image fie. The image file generating method is charac- 
terized by that the image data for printing and at least 

35 one of the image data sets at different resolutions are 
generated by applying direct interpolation processing 
on the digital image. 

The image obtaining apparatus means a cable 
interface and a memory card reader and the like to 

40 obtain an image from a film scanner or a digital camera. 
Furthermore, the image obtaining apparatus is meant to 
include a medium drive for reading a recording medium , 
wherein a digital image has been recorded and commu- 
nication equipment tor receiving a digital image trans- 

45 fened via a network. 

The print means high quality photographic print 
generated mainly by a photographic service provider. In 
other words, the resolution appropriate for printing 
means a resolution (for example. 1800 x 1000) high 

so enough to generate high quality photographic print. 

The image data sets at stepwise changing resolu- 
tions mean a combination of image data sets having 
resolutions 1/2, 1/4, 1/8, and 1/16 of the resolution of 
the digital image, tor example. 

55 The structured storage file has a hierarchy similar 
to a directory structure of a conventional file system. 
Each component composing the hierarchy can be dealt 
with by different kinds of application software. Since the 
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structured storage is widely known as a technique used 
in the Component Object Model (COM) proposed by 
Microsoft Corp., detailed explanation is not provided 
here. 

Upon interpolation processing, in the case of s 
enlargement ratio equal to or larger than 2 or reduction 
ratio equal to or smaller than 1/2, image quality cannot 
be maintained unless the length of an interpolation filter 
is extended. As a result calculation load becomes 
heavy. Therefore, among the image data sets at differ- io 
ent resolutions, image data sets at resolutions between 
1/2 and 2 times the resolution of the dgrtal image may 
be generated by directly interpolating the digital image, 
and the image data sets at resolutions other than the 
above may be generated by applying stepping interpo- 75 
latkxi processing on the image data sets at the resolu- 
tions within the above range. 

An image file generating apparatus of the present 
invention generates image data for printing at a resolu- 
tion appropriate for printing and image data sets at res- 20 
olutions changing stepwise and lower than the 
resolution of the image data tor printing by using a dig- 
ital image obtained by an image obtaining apparatus, 
and generates a structured storage fie comprising the 
image data for printing and at least one of image data 2s 
sets at different resolutions as components of the image 
file. The image file generating apparatus comprises 
printing image data generating means which generates 
the image data tor printing by directly applying interpo- 
lation processing on the digital image, stepping resdu- 30 
tkxi image data set generating means which generates 
at least one of the image data sets at different resolu- 
tions by applying direct interpolation processing on the 
digital image, and file generating means which gener- 
ates the structured storage file by using the image data 3S 
for printing and the image data sets at different resolu- 
tions. 

According to the image file generating method and 
apparatus of the present invention, upon generating the 
image data sets at different resolutions, the image data 40 
sets are generated by directly applying interpolation 
processing on a digital image having been obtained, 
rather than applying stepping interpolation processing 
on data of a high resolution image having been 
enlarged for printing. Therefore, degradation of image 45 
quality due to repeated interpolation processing can be 
minimized. 

Among the image data sets at different resolutions, 
if image data sets at resolutions between 1/2 and 2 
times the resolution of the digital image are generated so 
by directly interpolating the digital image, and the image 
data sets at resolutions other than the above are gener- 
ated by applying stepping interpolation processing on 
the image data sets at the resolutions within the above 
range, problems such as increased calculation load due ss 
to longer f Iter length can be avoided. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a diagram showing a configuration of a 
photograph finishing system on which an image file 
generating method of the present invention is 
applied; 

Figure 2 is a diagram showing an image file format 

based on the FlashPix standard; and 

Figure 3 is a diagram showing an embodiment of an 

image file generating apparatus of the present 

invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

Hereinafter, an image fie generating method and 
apparatus of the present invention will be explained with 
reference to the accompanying drawings. Figure 1 is a 
diagram showing a configuration of a photograph finish- 
ing system on which an image file generating method of 
the present invention is applied. As shown in this figure, 
this system comprises an image handling apparatus 1 
and a photographic printer 2 connected to the image 
handling apparatus 1. 

The image handling apparatus 1 is a general pur- 
pose personal computer wherein a dedicated program 
has been installed, for example. The image handling 
apparatus 1 comprises peripheral equipment or an 
interface for external equipment such as a film scanner 
tor reading a developed film 3, a card reader tor reading 
a memory card of a digital camera 4, or p. cable interface 
tor directly connecting to the dgrtal camera Further- 
more, the image handfing apparatus 1 comprises a 
medium drive for a CD-R, a Zip disc or the like, which is 
built in or connected externally. The image handling 
apparatus 1 also has communication equipment (not 
shown) for exchanging image data with other computers 
via a network. 

The photographic printer 2 is a known digital photo- 
graphic printer. The photographic printer 2 receives 
image data and output instructing information (for exam- 
ple, the quantity and the size of print) from the image 
handling apparatus 1 and outputs print based thereon. 

In the above system, the image handling apparatus 
1 carries out predetermined image processing on image 
data obtained from the developed film 3, and then trans- 
fers the image data to the photographic printer 2 and 
also records the image data in a recording medium 6 
such as a CD-R. The image handing apparatus 1 can 
also accept photograph images input from a recording 
medium as well as from a scanner as printing targets. 
The recording mecfium may be the recording medium 6 
wherein the image data have been recorded by this sys- 
tem, or a record ng medium other than that 

As a file format used upon recording a photograph 
image in a recording medium, a variety of formats such 
as BMP, TIFF, and GIF have been known. An image file 
generated by the file generating method of the present 
invention is a structured storage file comprising image 
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data sets at different resolutions. A structured storage 
file specifically means a file having a hierarchy as 
shown in Figure 2, and is defined in the FlashPix stand- 
ard proposed by Eastman Kodak Co. The hierarchy 
shown in Figure 2 shows a file as a whole. In storages 5 
ResokrtonO through Resolutions, image data sets 7 at 
different resolutions are recorded as header streams for 
each image data set showing the number of pixels, a 
compression type, and the like thereof, and data 
streams which are the image data sets themselves. 10 
Other storages and streams shown in Figure 2 are for 
recording various kinds of property information such as 
the date of image generation and the title of the image 
Explanation of these is not provided here, since they are 
known as the FlashPix standard. 15 

Hereinafter, an errfoodiment of an image f Pe gener- 
ating apparatus of the present invention will be 
explained with reference to Figure 3. The image file 
generating apparatus of the present invention is actually 
realized as a function of a photograph finishing system 20 
having a configuration shewn in Figure 1. 

As shown in Figure 3, image processing means 12 
carries out various kinds of quality enhancing image 
processing such as color/tone conversion processing or 
sharpness enhancement processing on an original 2s 
image 8 having been read from the developed film 3 by 
using a film scanner 1 1 or from a memory card of the 
digital camera 4 by using a card reader 10. Interpolation 
processing means 13a applies interpolation processing 
using a predetermined interpolation filter on the image 30 
having been processed, and image data 9 for printing 
are then generated. The image data 9 for printing are 
output by the photographic printer 2 as photographic 
print 5. 

Assume that the original image 8 has 1000 x 1000 35 
pixels and the image data 9 for printing 1500 x 1500, for 
example. In a conventional f fle generating method, the 
interpolation processing means 13a (printing image 
data generating means) applies interpolation enlarge- 
ment on the original image 8 in order to generate the 40 
image data 9 tor printing whose vertical and horizontal 
sizes are 1.5 times those of the original image 8. Inter- 
polation processing by another interpolation filter is then 
carried out on the image data 9 for printing having 1500 
x 1500 resolution, and a first image data set having 750 45 
x 750 resolution and horizontal and vertical sizes which 
are 1/2 of those of the image data 9 is generated, for 
example. Furthermore, interpolation processing is car- 
ried out on the first image data set having 750 x 750 res- 
olution, and a second image data set having 375 x 375 so 
resolution is generated. 

However, when interpolation processing is carried 
out. the sharpness generally decreases (generating a 
blurry image) and artifacts are created. Therefore, 
image quality degrades. Repeated interpolation ss 
processing means nothing but further degrading quality 
of a digital image which has already been in poor image 
quality. Therefore, to maintain image quality, it is prefer- 



able to minimize the repetition of interpolation process- 
ing as much as possfola 

Therefore, in the image file generating method and 
apparatus of the present invention, image data sets at 
different resolutions to be recorded in a recording 
medium are generated from the original image 8 rather 
than from the image data 9 for printing. In other words, 
as shown in Figure 3, interpolation processing means 
13b (stepping resolution image data set generating 
means) carries out interpolation processing cfirectly on 
a 1000 x 1000 image having been processed by the 
image processing means 12 and generates an image 
data set 7a at 750 x 750 resolution. In this case, the 
number of interpolation processing repetition necessary 
for generating the image data set at 750 x 750 resolu- 
tion is smaller than in the conventional method by 1, 
which can suppress the image quality deyadation. 

Likewise, if an image data set 7b is generated by 
carrying out direct interpolation processing on the origi- 
nal image 8 after image processing having been carried 
out thereon, interpolation processing is not repeated. 
However, since the image data set 7b at 375 x 375 res- 
olution has vertical and horizontal pixels fewer than 1/2 
of those of the original image 8 at 1000 x 1000 resolu- 
tion, interpolation processing maintaining image quality 
cannot be carried out unless the fitter length is extended 
to some degree. Therefore, when processing speed is 
important interpolation processing may be carried out 
in two manners. For example, if the image data set has 
the number of pixels equal to or larger than 1/2 of that of 
the original image 8 as shown in the example in Figure 
3, interpolation processing is carried out directly on the 
original image 8. Meanwhile, if smaller than 1/2, rt is car- 
ried out on the image data set at a closer resolution 
obtained by previous interpolation processing, as has 
been carried out conventionally. 

In the above example, each image data set is gen- 
erated by reducing the original image 8. However, the 
image data sets 7 at different resolutions may be 
obtained by enlarging the original image 8. In this case, 
as in the case of the reduction descrtoed above, interpo- 
lation processing takes long rf the number of pixels in 
horizontal or vertical direction of the image data set 
exceeds 2 times the number of those in the original 
image 8. Therefore, in order to reduce calculation load 
and to improve processing efficiency, interpolation 
processing may be carried out in two steps on the 
image data set at a resolution equal to or greater than 
two times the resolution of the original image 8, as has 
been carried out conventionally. 

The image data sets 7 at different resolutions hav- 
ing been generated in the above manner are recorded 
by file generating outputting means 14 in a recording 
medium as an image file in a format shown in Figure 2 
together with various kinds of property information. 
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Claims 

1. An image file generating method which generates 
image data for printing at a resolution appropriate 
tor printing and image data sets at different resolu- 
tions changing stepwise and lower than the resolu- 
tion of the image data for printing by using a digital 
image obtained by an image obtaining apparatus, 
and generates a structured storage fie comprising 
the image data tor printing and at least one of the 
image data sets at different resolutions as compo- 
nents of the fie, wherein 



w 



ferent resolutions, image data sets at resolutions 
between 1/2 and 2 times the resolution of the digital 
image are generated by directly interpolating the 
digital image, and 

the image data sets at resolutions other than 
the above are generated by applying stepping 
interpolation processing on the image data 
sets at the resolutions within the above range. 



the image data for printing and at least one of 
the image data sets at different resolutions are is 
generated by applying direct interpolation 
processing on the digital image. 

2. The image file generating method as claimed in 
Claim 1 , wherein among the image data sets at drf- 20 
ferent resolutions, image data sets at resolutions 
between 1/2 and 2 times the resolution of the cfigrtal 
image are generated by rjrectty interpolating the 
digital image, and 

25 

the image data sets at resolutions other than 
the above are generated by applying stepping 
interpolation processing on the image data 
sets at the resolutions within the above range. 

30 

3. An image file generatim apparatus which gener- 
ates image data for printir/! at a resolution appropri- 
ate for printing and image data sets at resolutions 
changing stepwise and lower than the resolution of 
the image data for printing by using a digital image 35 
obtained by an image obtaining apparatus and gen- 
erates a structured storage file comprising the 
image data for printing and at least one of the 
image data sets at different resolutions as compo- 
nents of the file, the image file generating appara- 40 
tus comprising: 



printing image data generating means which 
generates the image data for printing by 
directly applying interpolation processing on 45 
the cfigrtaJ image, 

stepping resolution image data set generating 
means which generates at least one of the 
image data sets at different resolutions by 
applying direct interpolation processing on the so 
digital image, and 

file generating means which generates the 
structured storage file by using the image data 
for printing and the image data sets at different 
resolutions. ss 



4. The image file generating apparatus as claimed in 
Claim 3, wherein among the image data sets at dif- 
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